Conditioning an Additive Functional of a Markov Chain to Stay Non-negative Ii: Hitting a High Level

نویسندگان

  • Saul D Jacka
  • Zorana Najdanovic
  • Jon Warren
چکیده

Let (Xt)t≥0 be a continuous-time irreducible Markov chain on a finite statespace E, let v : E → R\{0} and let (φt)t≥0 be defined by φt = ∫ t 0 v(Xs)ds. We consider the cases where the process (φt)t≥0 is oscillating and where (φt)t≥0 has a negative drift. In each of the cases we condition the process (Xt, φt)t≥0 on the event that (φt)t≥0 hits level y before hitting zero and prove weak convergence of the conditioned process as y → ∞. In addition, we show the relation between conditioning the process (φt)t≥0 with a negative drift to oscillate and conditioning it to stay non-negative until large time, and relation between conditioning (φt)t≥0 with a negative drift to drift to drift to +∞ and conditioning it to hit large levels before hitting zero.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Conditioning an Additive Functional of a Markov Chain to Stay Non-negative I:survival for a Long Time

Let (Xt)t≥0 be a continuous-time irreducible Markov chain on a finite statespace E, let v be a map v : E → R\{0} and let (φt)t≥0 be an additive functional defined by φt = ∫ t 0 v(Xs)ds. We consider the cases where the process (φt)t≥0 is oscillating and where (φt)t≥0 has a negative drift. In each of the cases we condition the process (Xt, φt)t≥0 on the event that (φt)t≥0 stays non-negative until...

متن کامل

Mapping Activity Diagram to Petri Net: Application of Markov Theory for Analyzing Non-Functional Parameters

The quality of an architectural design of a software system has a great influence on achieving non-functional requirements of a system. A regular software development project is often influenced by non-functional factors such as the customers' expectations about the performance and reliability of the software as well as the reduction of underlying risks. The evaluation of non-functional paramet...

متن کامل

Conditioned, quasi-stationary, restricted measures and escape from metastable states

We study the asymptotic hitting time τ (n) of a family of Markov processes X to a target set G when the process starts from a trap defined by very general properties. We give an explicit description of the law of X conditioned to stay within the trap, and from this we deduce the exponential distribution of τ . Our approach is very broad —it does not require reversibility, the target G does not ...

متن کامل

Limit Theorems for subgeometric Markov chains

This paper studies limit theorems for Markov Chains with general state space under conditions which imply subgeometric ergodicity. We obtain a central limit theorem and moderate deviation principles for additive not necessarily bounded functional of the Markov chains under drift and minorization conditions which are weaker than the Foster-Lyapunov conditions. The regeneration-split chain method...

متن کامل

Skip-free Random Walks with Markovian Increments

Let (ξk, k ≥ 0) be a Markov chain on {−1, +1} with ξ0 = 1 and transition probabilities P (ξk+1 = 1| ξk = 1) = a and P (ξk+1 = −1| ξk = −1) = b < a. Set X0 = 0, Xn = ξ1 + · · ·+ ξn and Mn = max0≤k≤n Xk. We prove that the process 2M − X has the same law as that of X conditioned to stay non-negative. Pitman’s representation theorem [19] states that, if (Xt, t ≥ 0) is a standard Brownian motion and...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005